Polynomial-Time Algorithms for Multirate Anypath 
Routing in Wireless Multihop Networks 

Rafael Laufer, Henri Dubois-Ferriere, and Leonard Kleinrock 
September 17, 2010 
Technical Report UCL A-CS D-TR 1 00034 



Abstract — In this paper we present a new routing paradigm 
that generalizes opportunistic routing for wireless multihop 
networks. In multirate anypath routing, each node uses both 
a set of next hops and a selected transmission rate to reach a 
destination. Using this rate, a packet is broadcast to the nodes in 
the set and one of them forwards the packet on to the destination. 
To date, there has been no theory capable of jointly optimizing 
both the set of next hops and the transmission rate used by 
each node. We solve this by introducing two polynomial-time 
routing algorithms and provide the proof of their optimality. The 
proposed algorithms run in roughly the same running time as 
regular shortest-path algorithms, and are therefore suitable for 
deployment in routing protocols. We conducted measurements in 
an 802.11b testbed network, and our trace-driven analysis shows 
that multirate anypath routing performs on average 80% and 
up to 6.4 times better than anypath routing with a fixed rate 
of 11 Mbps. If the rate is fixed at 1 Mbps instead, performance 
improves by up to one order of magnitude. 

Index Terms — wireless multihop networks, opportunistic rout- 
ing, anypath routing, routing algorithms, multirate. 

I. Introduction 

ROUTING in wireless multihop networks is challenging 
due to the high loss rate and dynamic quality of wireless 
links IH-flU ■ Anypath routing has been recently proposed as a 
way to circumvent these shortcomings by using multiple next 
hops for each destination |6|-|9|. Each packet is broadcast 
to a forwarding set composed of several neighbors, and the 
packet is lost only if none of these neighbors receive it. 
Therefore, while the link to a given neighbor is down or 
performing poorly, another nearby neighbor may receive the 
packet and forward it on. This is in contrast to single-path 
routing where only one neighbor is assigned as the next hop 
for each destination. In this case, if the link to this neighbor is 
poor, a packet may be lost even though other neighbors may 
have overheard it. 

Existing work on anypath routing has focused on wireless 
networks that use a single ttansmission rate. However, certain 
wireless systems offer multiple transmission rates at the phys- 
ical layer; this is notably the case for 802.1 la/b/g/n. For these 
physical layers, restricting multihop communication to a single 
bit rate means that routing decisions cannot take advantage 
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of different modulation/coding schemes and the associated 
tradeoff. This presents at least two drawbacks. First, using 
a single rate over the entire network underutilizes available 
bandwidth resources. Some links may perform well at a higher 
rate, while others may only work at a lower rate. Second, and 
most importantly, the network may become disconnected at a 
higher bit rate. We provide experimental measurements from 
an 802.11b testbed which show that this phenomenon is not 
uncommon in practice. The key problem is that higher bit rates 
have a shorter transmission range, which reduces the network 
connectivity. As the rate increases, links becomes lossier and 
the network eventually gets disconnected. Therefore, in order 
to guarantee connectivity, single-rate anypath routing must be 
limited to low rates. 

In multirate anypath routing, these problems do not exist; 
however, we face different challenges. First, loss probabilities 
increase with higher transmission rates, so a higher bit rate 
does not always improve throughput. Second, we must find 
not only the forwarding set, but also the transmission rate at 
each hop that jointly minimizes its cost to a destination. For 
instance, assuming that links (i,k), and (i, I) achieve 

their highest throughput at 2, 5.5, and 11 Mbps, respectively, 
which subset of neighbors should node i use to reach the 
destination and at which rate should the packet be transmitted? 
Finally, higher rates have a shorter transmission range and 
therefore we have a different connectivity graph for each rate. 
Lower rates have more neighbors available for inclusion in the 
forwarding set (i.e., more spatial diversity) and fewer hops 
between nodes. Higher rates have fewer neighbors available 
for the forwarding set (i.e., less spatial diversity) and longer 
routes iflOll . Finding the optimal operation point in this tradeoff 
is the focus of this paper. 

We thus address the problem of finding both a forwarding 
set and a transmission rate for every node, such that the overall 
cost of every node to a particular destination is minimized. 
We call this the shortest multirate anypath problem. To our 
knowledge, this is still an open problem 161, fj\, ifTTI . and we 
believe our algorithms are the first practical solution for it. 

e introduce two polynomial-time routing algorithms to 
the shortest multirate anypath problem and present a proof 
of their optimality. Our solution generalizes Dijkstra's and 
Bellman-Ford algorithms for the multirate anypath case and 
are applicable to both link-state and distance-vector routing 
protocols, respectively. One would expect the running time of 
such algorithms to be exponential, since with n neighbors we 
can have up to 2™ — 1 forwarding sets. However, we show that 
the proposed algorithms have roughly the same polynomial 
time as the corresponding shortest-path algorithms, and are 
suitable for implementation at current wireless routers. We 
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also provide a generalization of the expected transmission time 
(ETT) routing metric 1T21 for multirate anypath routing. 

To evaluate performance, we conducted measurements in 
an 18-node 802.11b wireless testbed of embedded Linux 
devices. Our results reveal that the network becomes partially 
disconnected if we fix the transmission rate of every node at 
2, 5.5, or 11 Mpbs. A single-rate routing scheme therefore 
performs poorly in this case, since 1 Mbps is the only rate 
at which the network is fully connected. Using a trace-driven 
analysis, we show that multirate anypath routing improves the 
end-to-end expected transmission time by 80% on average and 
up to 6.4 times compared to single-rate anypath routing at 
1 1 Mbps, while still maintaining full network connectivity. The 
performance is even higher for the single-rate case at 1 Mbps, 
with an average gain of a factor of 5.4 and a maximum gain 
of a factor of 1 1.3. 

The remainder of this paper is organized as follows. Sec- 
tion [LI] reviews the basic theory of anypath routing and our 
network model and assumptions. In Section [TTTJ we introduce 
multirate anypath routing and the proposed routing metric. 
Section [TV] presents the multirate anypath algorithms and 
proves their optimality. Section [V] reveals the results of our 
evaluation, showing the benefits of multirate over single-rate 
anypath routing. Section [VTJ presents the related work in any- 
path routing. Finally, conclusions are presented in Section [VTIl 

II. Anypath Routing 

In this section we review the anypath routing theory intro- 
duced by Zhong et al. [8] and Dubois-Ferriere et al. [9|. We 
also generalize this theory to support correlated link losses. 

A. Overview 

In classic wireless network routing, each node forwards a 
packet to a single next hop. As a result, if the transmission to 
that next hop fails, the node needs to retransmit the packet even 
though other neighbors may have overheard it. In contrast, in 
anypath routing, each node broadcasts a packet to multiple 
next hops simultaneously. Therefore, if the transmission to one 
neighbor fails, an alternative neighbor who received the packet 
can forward it on. We define this set of multiple next hops 
as the forwarding set, and we usually use J to represent it 
throughout the paper. A different forwarding set is used to 
reach each destination, in the same way that a distinct next 
hop is used for each destination in classic routing. 

When a packet is broadcast to the forwarding set, more than 
one node may receive the same packet. To avoid unnecessary 
duplicate forwarding, only one of these nodes should forward 
the packet on. For this purpose, each node in the set has a 
priority in relaying the received packet. A node only forwards 
a packet if all higher priority nodes in the set failed to 
do so. Higher priorities are assigned to nodes with lower 
costs to the destination. As a result, if the node with the 
lowest cost in the forwarding set successfully received the 
packet, it forwards the packet to the destination while others 
suppress their transmission. Otherwise, the node with the 
second lowest cost forwards the packet, and so on. A reliable 
anycast scheme lfl~3l is necessary to enforce this relay priority. 
We talk more about this in Section IH-BI The source keeps 



rebroadcasting the packet until someone in the forwarding set 
receives it or a threshold is reached. Once a neighbor in the set 
receives the packet, this neighbor repeats the same procedure 
until the packet is delivered to the destination. 

Since we now use a set of next hops to forward packets, 
every two nodes are connected through a mesh composed of 
multiple paths. Fig. Q] depicts this scenario where each node 
uses a set of neighbors to forward packets. The forwarding sets 
are defined by the multiple bold arrows leaving each node. We 
define this set of paths between two nodes as an anypath. In the 
figure, the anypath shown in bold is composed by 1 1 different 
paths between a source s and a destination d. Depending on the 
choice of each forwarding set, different paths are included in 
or excluded from the anypath. At every hop, only a single node 
of the set forwards the packet on. Consequently, every packet 
from s traverses only one of the available paths to reach d. We 
show a path possibly taken by a packet using a dashed line. 
Succeeding packets, however, may take completely different 
paths; hence the name anypath. The path taken is determined 
on the fly, depending on which nodes of the forwarding set 
successfully receive the packet at each hop. 




Figure 1. An anypath connecting nodes s and d is shown in bold arrows. 
The anypath is composed of the set of 11 paths between the two nodes. 
Every packet sent from s traverses one of these paths to reach d, such as the 
path shown with a dashed line. Different packets may traverse different paths, 
depending on which nodes receive the forwarded packet at each hop; hence 
the name anypath. 

B. System Model and Assumptions 

In order to support the point-to-multipoint links used in 
anypath routing, we model the wireless mesh network as a 
hypergraph. A hypergraph Q = (V, £) is composed of a set V 
of vertices or nodes and a set £ of hyperedges or hyperlinks. 
A hyperlink is an ordered pair (i,J), where i G V is a node 
and J is a nonempty subset of V composed of neighbors of i. 
For each hyperlink (i, J) G £, we have a delivery ratio pij 
and a cost dij. If the set J has a single element j, then we 
just use j instead of J in our notation. In this case, p^ and dij 
denote the link delivery ratio and the link cost, respectively. 

The hyperlink delivery ratio pu is defined as the probability 
that a packet transmitted from i is successfully received by at 
least one of the nodes in J. If J = {1, 2, . . . , n}, then pu is 



PiJ = l-P[X 1 = 0,X 2 = 0,...,X n = 0], 



(1) 



where Xj is a random variable equal to or 1 if node j G J 
loses or receives a packet transmitted by i, respectively. If 
packet losses occur independently at different receivers, as in 
light load regimes (Section [V), then the ratio pij is simplified 
to 1 — Y\j e ]{^—Pij), which can be calculated from the 
individual link delivery ratios pij. For high network loads, 
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however, interference may induce some correlation among 
neighbor links, and this may not be a perfect estimate of pij. 
Nonetheless, regardless of correlation or independence, the 
ratio p^j can always be locally estimated at node i using 
active (e.g., periodic probing and reporting to neighbors) or 
passive (e.g., unackownledged data frames) measurements, 
which should be performed periodically for better accuracy. 
Since pij is basically the fraction of successful MAC frames 
transmitted to J, it already takes into account the effect of path 
loss and interference on packet reception. Similar approaches 
for estimating delivery ratios are used in Q, ifTZl . Ifl4l . |15|. 

We experimentally estimate the delivery ratios of our testbed 
in Section[V] Nonetheless, for ease of presentation, we assume 
in our examples that link loss probabilities are known and 
independent at each receiver. The independence assumption, 
however, is not necessary for our routing algorithms to work; 
our optimality proofs are general and also hold for the case 
of correlated losses. This is in contrast to previous work on 
anypath routing |6|-|9|, which always assumes link losses are 
independent, even though some correlation may indeed occur 
in practice lfl6l, ifTTt 

Previously proposed MAC protocols have been designed to 
guarantee the relay priority among the nodes in the forwarding 
set 17), ff3l . lfl"8l . Such protocols can use different strategies 
for this purpose, such as time-slotted access, prioritized con- 
tention, and frame overhearing. Reliable anycast is an active 
area of research, and we assume that such a mechanism is 
in place to ensure that the relaying priority is respected. The 
details of the MAC, however, are abstracted from the routing 
layer. Practical routing protocols only incorporate the delivery 
ratios into the routing metric in order to abstract from the 
MAC details HI 211 . |[T4]l and we take the same approach. The 
only MAC aspect that is important is the effectiveness of the 
relaying node selection. 

C. Anypath Cost 

In this section we explain how to calculate the anypath cost 
from a node i to a given destination via a forwarding set J. 
The anypath cost Di is defined as Di — dij + Dj, which 
is composed of the hyperlink cost dij from i to J and the 
remaining anypath cost Dj from J to the destination. We 
now explain each one of these costs in detail. 

The hyperlink cost di j depends on the routing metric used. 
Most of the previous works on anypath routing adopted the 
expected number of anypath transmissions (EATX) as the 
routing metric (6), (8), ||9). The EATX is a generalization 
of the unidirectional ETX metric lfT4l . which is defined as 
dij — l/pij- The cost rfy for ETX represents the expected 
number of transmissions necessary for a packet sent by i 
to be successfully received by j. This metric generalizes the 
previous hop count metric by including the link quality into 
the cost. For EATX, the cost du is defined as du = 1/pij, 
which is the average number of transmissions necessary for at 
least one node in J to correctly receive the transmitted packet. 

The remaining anypath cost Dj is defined as a weighted 
average of the costs of the nodes in the forwarding set 
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where the weight Wij in (f2]l is the probability of node j being 
the relaying node of a packet from node i. For example, let 
the forwarding set be defined as J = {1, 2, . . . , n} with costs 
D\ < D2 < ■ . ■ < D n . Node j will be the relaying node 
only when it receives the packet and none of the nodes with 
a lower cost also receive it, which happens with probability 
P[X 1 = 0, . . . , = 0, Xj = 1 ]. The weight io y is then 

_ P[X 1 =0,...,X J -_ 1 ^0,X J - = 1] 

Wij ~ i-p[x 1 = o,x 2 = o,...,x n = oy (i) 

with the denominator being the normalizing constant. The 
weight Wij in © can also be interpreted as the probability 
of node j being the relaying node, given that at least one of 
the nodes in J received the packet. For the case of independent 
losses, the weight to^ can be simplified to 

3-1 

Pij II i 1 -Pik) 

(4) 



fc=l 



Pij) 



As an example, consider the network depicted in Fig. |2] 
Let J be the two-node forwarding set in Fig. |2(a)| and let J' be 
the three-node forwarding set in Fig. |2(b)| The weight of each 
link represents the link delivery ratio, which is the inverse of 
the expected number of transmissions (ETX). The cost via J 
in Fig. |2(a)| is calculated as 

Di = d u + Dj 



1 



(0.3)2.0+ (1 - 0.3)(0.2)3.3 



1 - (1 - 0.3)(1 - 0.2) 
= 2.3 + 2.4 = 4.7. 



1 - (1 - 0.3)(1 - 0.2) 



(5) 



One would expect that adding an extra node to the forwarding 
set is always beneficial because it increases the number of 
possible paths a packet can take. However, this is not always 
true, as shown in Fig. |2(b)| The anypath cost via J' = JU {j} 
is Di = diji + Dj, = 1.2 + 6.0 = 7.2. On one hand, using J' 
instead of J reduces the hyperlink cost; that is, diji < dij. 
On the other hand, the extra node increases the remaining 
anypath cost; that is, Dj, > Dj. If the increase Dji — Dj 
is higher than the decrease dij — dij>, adding this extra node 
is not worthwhile since the total cost to reach the destination 
increases. The intuition here is that when node j is the only 
one in J' to receive the packet, it is cheaper to retransmit the 
packet to one of the two nodes in J and take a shorter path 
from there than to take the long path via node j. 

. 7' 
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(a) (b) 
Figure 2. An anypath cost calculation example. The weights represent the 
link delivery ratios. The anypath cost in (a) is lower than the cost in (b). 

Once the cost of an anypath is defined, we can find the 
anypath with the lowest cost; that is, the shortest anypath. 
This is called the shortest-anypath problem [9|. Interestingly, 
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the shortest anypath will always have an equal or lower cost 
than the shortest single path. This is a direct consequence 
of the definition of an anypath as a set of paths. Among 
all possible anypaths between two nodes, we also have the 
anypath composed only of the path with the lowest cost. 
Therefore, if we are to choose the shortest anypath among 
all these possibilities, we know for sure that its cost can never 
be higher than the cost of the shortest single path. 

III. Multirate Anypath Routing 

Previous work on anypath routing focused on a single 
bit rate |6|-|9|. Such an assumption, however, considerably 
underutilizes available bandwidth resources. Some hyperlinks 
may be able to sustain a higher transmission rate, while others 
may only work at a lower rate. Additionally, the transmission 
range and therefore the network topology change with the rate, 
which makes multirate a challenge for routing. To date, the 
problem of how to select the transmission rate for anypath 
routing is still open (6), ifTTI . We provide a solution to this 
problem and incorporate the multirate capability inherent in 
802.11 networks into anypath routing. In this case, besides 
selecting a set of next hops for packet forwarding, a node must 
also select a transmission rate. For each destination, a node 
then keeps both a forwarding set and a rate used to reach this 
set. As a result, every two nodes will be connected through a 
mesh composed of multiple paths, with each node transmitting 
at a selected rate. Fig. [4] depicts this scenario. We define 
this set of paths between two nodes, with each node using 
a potentially different bit rate, as a multirate anypath. In the 
figure, a packet is sent from s to d over the multirate anypath. 
Only one of the available paths is traversed, depending on 
which nodes successfully receive the packet at each hop. We 
show a path possibly taken by the packet using dashed lines. 
We use different dash lengths to represent the different rates 
used by each node. A shorter dash represents a shorter time 
to send a packet, hence a higher rate. Succeeding packets may 
take completely different paths with other rates along the way. 
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Figure 4. A multirate anypath connecting nodes s and d is shown in bold 
arrows. Every packet sent from s traverses a path to reach d, such as the 
path shown with dashed lines. Different dash lengths represent the different 
bit rates used by each node, with a shorter dash for higher rates. Altough not 
illustrated, the node degree and network topology change for different rates. 

In order to support multirate, we must extend the system 
model in Section IH-BI Let R be the set of available bit rates 
that nodes can use to transmit their packets. For each hyperlink 
(i, J) £ £, we now have a delivery ratio p^j and a cost djj 
associated with each transmission rate r £ R. In real wireless 
networks, we have different delivery ratios and costs for each 
transmission rate, which justifies this model extension. 



The EATX metric described in Section III-CI was originally 
designed considering that nodes transmit at a single bit rate. 
To account for multiple bit rates, we introduce the expected 
anypath transmission time (EATT) metric. For EATT, the 
hyperlink cost d.y for each rate r £ R is defined as 
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where p'fj is the hyperlink delivery ratio defined in (Q~|i, s 
is the maximum packet size, and r is the bit rate. The cost 

(r) 

d^y is the time taken to transmit a packet of size s at a bit 
rate r over a lossy hyperlink with delivery ratio p~Q ■ The 
EATT metric is a generalization of the expected transmission 
time (ETT) metric 1 12 1, commonly used in single-path wireless 
routing. Note that for each bit rate r £ R, we have a different 

(r) 

delivery ratio pW, which usually decreases for higher rates. 
This behavior imposes a tradeoff; a higher bit rate decreases 
the time of a single packet transmission (i.e., s/r decreases), 
but it usually increases the number of transmissions required 

(r) 

for a packet to be successfully received (i.e., l/p\ / increases). 

The remaining anypath cost Dy now also depends on the 
transmission rate, since the delivery ratios change for each 
rate. Since both the hyperlink cost and the remaining anypath 
cost depend on the bit rate, node i has a different anypath 

(r) (r) (r) 

cost D\ = djj +Dj for each forwarding set J and for each 
transmission rate r £ R. The remaining anypath cost Dj for 
a rate r £ R is defined as 
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where the weight w\ r -' in (0 is the probability of node j being 

(r) 

the relaying node for node i, and Dj = min re .RD^ is the 

lowest cost from node j to the destination among all rates. 

(VI 

The weight to, - is then defined as 
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where Xj is a random variable equal to or 1 if j £ J 
respectively loses or receives a packet transmitted at rate r by 



node i. For the case of independent losses, the weight w tJ 
can be simplified to 



(r) fc=l 
y ■ — 
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We address the problem of finding both the forwarding 
set and the transmission rate that minimize the overall cost 
to reach a particular destination. We call this the shortest 
multirate anypath problem, which generalizes the shortest- 
anypath problem (51 for the multirate scenario. Interestingly, 
the shortest multirate anypath will always have equal or lower 
cost than a shortest anypath using a single transmission rate. 
Among all possible multirate anypaths between two nodes, we 
also have the shortest single-rate anypaths. As a result, the cost 
of the shortest multirate anypath can never be higher than the 
cost of any of the shortest single-rate anypaths. 
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Figure 3. Execution of the Shortest Anypath First (SAF) algorithm from every node to d. The link weights represent the link delivery ratios, the value inside 
a node i is its cost Di to d (i.e., the end-to-end expected number of transmissions), and the arrows in boldface represent the shortest anypath to d. (a) The 
situation just after the initialization, (b)-(g) The situation after each successive iteration of the algorithm, (h) The situation after the last node is settled. 



IV. Finding the Shortest Multirate Anypath 

In this section we introduce our shortest-anypath algorithms. 
In Section IIV-AI we present the Shortest Anypath First (SAF) 
and the Anypath Bellman-Ford (ABF) algorithms used in a 
single-rate network with the EATX metric. Similar single- 
rate algorithms were also proposed by Chachulski [6|. We, 
however, derived these algorithms independently and later in 
Section IIV-BI we introduce a generalization of these algorithm 
for multiple rates. Surprisingly, the Shortest Multirate Any- 
path First (SMAF) and the Multirate Anypath Bellman-Ford 
(MABF) algorithms have roughly the same running time as 
the corresponding shortest single-path algorithms for multi- 
rate. We only show the proof of optimality of the multirate 
algorithms, since by definition this also implies the optimality 
of the single-rate algorithms. 

A. The Single-Rate Case 

We now present the Shortest Anypath First (SAF) algo- 
rithm used in the simpler single-rate scenario. Given a graph 
G = (V, E), the algorithm calculates the shortest anypaths 
from all nodes to a destination d. For every node i e V we 
keep an estimate Di, which is an upper-bound on the cost of 
the shortest anypath from i to d. In addition, we also keep 
a forwarding set Fi for every node, which stores the set of 
nodes used as the next hops to reach d. Finally, we keep two 
data structures, namely S and Q. The S set stores the set of 
nodes for which we already have a shortest anypath defined. 
We store each node i 6 V — S for which we still do not have 
a shortest anypath in a priority queue Q keyed by their Di 
values. 

Lines 1-3 initialize the state variables Di and Fi and line 4 
sets to zero the cost from node d to itself. Lines 5-6 initialize 
the S and Q data structures. Initially, we do not have the 
shortest anypath from any node, so S is initially empty and 
thus Q contains all vertices. As in the shortest-path algorithm, 
the Shortest Anypath First algorithm is composed of \V\ 
rounds, dictated by the number of elements initially in Q. At 
each round, the EXTRACT-MlN procedure extracts the node 
with the minimum cost to d from Q. Let this node be j. At 
this point, j is settled and inserted into S, since the shortest 
anypath from j to the destination is now known. For each 
incoming edge G E, we check if the cost is larger 

than the cost Dj. If that is the case, then node j is added to 
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for each node i in V 

do Di <— oo 

F % <-0 

D d <-0 
S*^-0 

while Q ^ 

do j «- Extract-Min(Q) 
S^SU {j} 

for each incoming edge in E 

do J <- F, U {j} 
if Di > Dj 
then Di «- d tJ + Dj 

Fi «- J 



the forwarding set Fi and the cost Di is updated. 

Fig. [3] shows the step-by-step execution of the SAF algo- 
rithm using the EATX metric. The link weights represent the 
link delivery ratios. Fig. |3(a) depicts the graph right after 
the initialization and Fig. 3(b)f|3(h)] show each iteration of 
the algorithm. The value inside a node i presents its cost Di 
to the destination d (i.e., the end-to-end expected number of 
transmissions), and the arrows in boldface present the shortest 
anypath to d. Nodes with two circles are the settled nodes 
in S; each iteration settles a new node. The graph in Fig. |3(h)| 
shows the result of the SAF algorithm right after settling the 
last node. 

The running time of the SAF algorithm depends on how Q 
is implemented. Assuming we have a Fibonacci heap, the cost 
of each of the |V| EXTRACT-MlN operations in line 8 takes 
0(\ogV), with a total aggregated time of 0(V \ogV). The 
node cost in line 13 can be updated in a constant time, as 
follows. Let Di be the cost using a forwarding set J and 
let D\ be the cost using J' = J U {j}, with Dj > D k for 
all k £ J. The new cost D^ can then be calculated from the 
previous cost Di as 



D[ = du> + Dj, 

ViJ , . PiJ n , / 1 PiJ 
= dij H Dj +1 



PiJ' 



PiJ' 



PiJ' 



D. 



—Di + ( 1 - — I Dj, 

PiJ' V PiJ' 
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where Pij/pw scales dij and Dj to account for the new 
forwarding set J' while 1 — pij /pw is the weight of Dj 
in Dji. The cost Di in line 13 is then updated using just the 
previous cost and Dj. The for loop of lines 10-13 takes 0(E) 
aggregated time and the total complexity is 0(V\ogV + E), 
which is the same complexity as Dijkstra's algorithm. 

We also present the Anypath Bellman-Ford (ABF) 
algorithm, which can be implemented in a distributed 
fashion. The ABF algorithm reduces the complexity of the 
Bellman-Ford anypath generalization proposed in ||9l from 
exponential to polynomial time due to a property we show 
in Section IIV-BI As in the regular Bellman-Ford, the ABF 
algorithm is also composed of at most \V\ — 1 rounds. At 
each round, every node i stores its neighbors in a priority 
queue Q keyed by their cost. We then check each neighbor j 
in ascending order of cost Dj, and verify whether Di is 
larger than Dj. If that is the case, node i includes j in 
its forwarding set and updates its distance accordingly. 
Intuitively, the algorithm works in the same expanding-ring 
fashion as the regular Bellman-Ford, settling at each round the 
costs of the nodes one hop further away from the destination. 
Since an anypath can not be longer than \V\ — 1 hops, the 
algorithm converges after at most \V\ — 1 iterations. 

Anypath-Bellman-Ford(G, d) 
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for each node i in V 

do Di 4- oo 

F t 4-% 
D d 4-0 

for t 4- 1 to \V\ - 1 
do for each node i in V 

do J 4- 



Q 4- Get-Neighbors(i) 
while Q + 
do j 4- Extract-Min(Q) 
J 4- J U {j} 
if Di > Dj 

then Di 4- du + Dj 
Ft 4- J 



Fig. shows the step-by-step execution of the ABF algo- 



rithm using the EATX metric. Fig. 5(a) depicts the graph just 
after the initialization and Fig. |5(b)f[5(f)l show each iteration 
of the algorithm. The value inside a node i presents its cost Di 
to d (i.e., the end-to-end expected number of transmissions), 
and the arrows in boldface present the shortes anypath to d. 
The graph in Fig. |5(f)| shows the result of the ABF algorithm. 

The running time of the ABF algorithm depends on how Q 
is implemented. Assuming a Fibonacci heap, each of the 
EXTRACT-MlN operations in line 10 takes log(V) at the most. 
The for loop in lines 6-14 runs once for each link, for a total 
aggregated time of 0(E log V). The total complexity of the 
ABF algorithm is then 0(VE\ogV), which is only a factor 
of log V higher than the regular Bellman-Ford algorithm. 

B. The Multirate Case 

We now generalize the SAF algorithm to support multiple 
transmission rates, introducing the Shortest Multirate Anypath 
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Figure 5. Execution of the Anypath Bellman-Ford (ABF) algorithm from 
every node to d. The weights represent the link delivery ratios, the value 
inside a node i represents its cost Di to d (i.e., the end-to-end expected 
number of transmissions), and the arrows in boldface represent the shortest 
anypath to d. (a) The situation just after the initialization, (b)-(f) The situation 
after each successive iteration. Node costs are updated considering the costs 
in the previous iteration. 

First (SMAF) algorithm. For each node i E V, we now keep 

(r) 

a different cost estimate D\ ' for every rate r G R. The 

(r) 

estimate D\ is an upper-bound on the cost of the shortest 
anypath from i to d using transmission rate r. In addition, we 
also keep its corresponding forwarding set F$ r , which stores 
the set of next hops used for i to reach d using r. We use Di 
and Fi without the indicated rates to store the minimum cost 
estimate among all rates and its corresponding forwarding 
set, respectively. We also keep a transmission rate T, for 
every node, which stores the optimal rate used to reach d. 

Shortest-Multirate-Anypath-First(G, d) 
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for each node i in V 

do Di <— oo 

Ti <- NIL 

for each rate r in R 



do D> 

Fa 



(r) 



D d 
Q <r 



V 



while Q ^ 

do j 4- Extract-Min(Q) 
S^SU {j} 

for each incoming edge in E 
do for each rate r in R 



do J 



- *} r) U {j} 



if D)'' > D 



then D> ' 4- d 
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iJ 
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Figure 6. The advantage of multirate over single-rate anypath routing, (a) Each pair of weights (11)1,11)2) represents the link delivery ratio at 1 Mbps and 
2 Mbps, respectively. The value inside a node i is its cost Di to d using the EATT metric (i.e., the end-to-end expected transmissions time in milliseconds), 
and the arrows in boldface represent the shortest multirate anypath to d. (b) The shortest anypath at 1 Mbps. (c) The shortest anypath at 2 Mbps. (d) The 
shortest multirate anypath using both 1 Mbps (dark gray arrows) and 2 Mbps (light gray arrows) rates. The multirate anypath in (d) takes advantage of the 
best rate at each node to yield the lowest cost. 



The idea of the SMAF algorithm is that each node i £ V 

(r) 

has an independent cost estimate D\ for each rate r G R and 
we keep the minimum of these estimates as the node cost Di. 
At each round of the while loop, the node with the minimum 
cost from Q is settled. Let this node be j. For each incoming 
edge G E, we check for every rate r € R if the cost 

(r) 

D\ is larger than the cost Dj of the node just settled. If this 
is the case, then node j is added to the forwarding set of 

(r) 

that specific rate and cost D) is updated accordingly. If the 

(r) 

new cost D\ is lower than the node cost Di, we update Di as 
well as the forwarding set Fi and transmission rate Ti to reflect 
the new minimum. The running time of the Shortest Multirate 
Anypath First algorithm is 0(V\ogV + ER), which is the 
same running time of the shortest single-path algorithm for 
multiple rates. 

We also introduce the Multirate Anypath Bellman-Ford 
(MABF), a generalization of the ABF algorithm for multiple 
transmission rates. The MABF uses the same idea of keeping a 
different estimate cost D^ for each rate r G R and taking the 
minimum as the node cost. The running time of the MABF 
algorithm is 0(VE logV + VER), where 0(VE logV) is 
the aggregated time of the EXTRACT-MlN operations and 
0(VER) is the aggregated time of the for loop in lines 14-22. 

Multirate- Anypath-Bellman-Ford(G, d) 

1 for each node i in V 

2 do Di oo 

3 F t 4-% 

4 T t 4- NIL 

5 for each rate r in R 

6 do £>/ r) 4- oo 

7 Ff> 4- 

8 D d 4-0 

9 for t 4- 1 to \V\ - 1 

10 do for each node i in V 

11 do Q 4- Get-Neighbors(i) 

12 while Q ^ 

13 do j 4- Extract-Min(Q) 

14 for each rate r in R 

15 do J 4- F^ U {j} 
16 
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if A (r) > D 3 



then D 

F- 



d lJ + Dj 
J 



if Di > D 



(r) 



then Di 4- D 



(r) 



F i 4-F i 
T,4- r 
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Fig. [6] shows the advantage of multirate over single-rate 
anypath routing. Fig. |6(a)| depicts a network topology, with 
each pair of weights (w\,W2) representing the link delivery 
ratio at 1 Mbps and 2 Mbps, respectively. The value inside 
each node i is its cost Di to d using the EATT metric (i.e., 
the end-to-end expected transmission time in milliseconds). 
Fig. |6(b)| shows the shortest single-rate anypath at 1 Mbps 
(i.e., cost of 87 ms); Fig. |6(c)| shows the same result at 2 Mbps 
(i.e., cost of 96 ms). In our example, nodes further from d 
have a lower cost when transmitting at 1 Mbps, as shown 
in (b). On the other hand, nodes closer to d achieve a lower 
cost at 2 Mbps, as shown in (c). Using a single transmission 
rate therefore does not allow nodes to reduce their costs by 
much. The shortest multirate anypath in |6(d)[ however, takes 
advantage of the best rate at each node to yield the lowest cost 
(i.e., 75 ms). 



C. Optimality 

In order to prove the optimality of the algorithm, we first 
introduce five lemmas that show a few properties of multirate 
anypath routing. We use <): ; as the cost of the shortest 
multirate anypath from a node i to the destination d, when i 

(r) 

transmits at a fixed rate r G R. Likewise, q>\ ' represents the 
corresponding forwarding set used in this multirate anypath. 
We use Si without the indicated rate to represent the cost of 
the shortest multirate anypath from i to d via the optimal 
forwarding set 0; and optimal transmission rate p G R. That is, 



dp) 



Si = mm reR S^\ p = argmin I , 6J? ^ r) , and fa = fa p ' . We 
use Di as the cost of a particular multirate anypath from i 
to d, but not necessarily the shortest one. The proof for each 
of these lemmas is available in the Appendix. 

Lemma 1: For a fixed transmission rate, let Di be the cost 
of a node i via forwarding set J and let D[ be the cost via 
forwarding set J' = J U {k}, where D^ > Dj for every node 
j G J. We have D[ < Di if and only if Di > D^. 

We use Lemma Q] for the comparisons in line 12 of the SAF 
and ABF algorithms, as well as in line 17 of the SMAF and 
line 16 of the MABF algorithms. By this lemma, if the cost Di 
via J is larger than the cost Dk of a neighbor node k, with 
Dk > Dj for all j G J, then the cost D[ via J' = J U {A:} is 
always lower than Di, that is, it is always beneficial to include 
node k in the forwarding set in order to obtain a lower cost 
to the destination. 

Lemma 2: The lowest cost Si of a node i is always larger 
than or equal to the lowest cost Sj of any node j in the optimal 
forwarding set fa. That is, we have Si > Sj for all j G fa. 



Lemma [2] guarantees that if a node i uses another node j in 
its optimal forwarding set fa, then cost Si can never be smaller 
than Sj, This is equivalent to the restriction that all weights 
in the graph must be nonnegative. Note that this property also 
implies that no cycles can occur in an anypath. If a node i uses 
a node j in its forwarding set, then according to Lemma [2] 
we must have Si > Sj. If, however, node j also uses node i 
in its forwarding set (a cycle), we must also have Si < Sj. 
Therefore, we can only have a cycle when S{ = Sj. However, 
we show in the next lemma that these cycles do not change 
the anypath cost. As a result, we use strict comparisons in our 
algorithms to prevent such cycles from occuring in practice. 
Due to the same reason, larger cycles with more than two 
nodes can not occur either and the shortest anypath is always 
a directed acyclic graph (DAG). 

Lemma 3: For any transmission rate, if a node i uses a 
node k in its optimal forwarding set fa and Si = 5k, we can 
safely remove k from fa without changing Si- The link (i,k) 
is said to be "redundant." 

By Lemma [3] if the costs 5{ = 5k of two nodes i and k are 
the same, then the cost Si via forwarding set fa is the same 
as the cost via the set fa ~ {k}. That is, the cost of node i 
does not change if it uses k in its forwarding set or not. 

Lemma 4: If the lowest costs from the neighbors of a 

node i to a given destination are 5± < 62 < . . . < 5 n , 

(r) 

then the optimal forwarding set fa] is always of the form 
4>p = {1,2,..., k}, for some k G {1, 2, . . . , n}. 

According to Lemma [4] the best forwarding set cf>^ for 
transmission rate r G R is a subset of neighbors with the 
lowest costs to the destination. That is, given a set of neighbors 
with costs 5\ < 52 < ... < 5 n , the best forwarding 
set 4>i when using rate r G R is always one of {1}, {1, 2}, 
{1, 2, 3}, ...,{1,2,..., n). As a result, forwarding sets with 
gaps between the neighbors, such as {2,3} or {1,4}, can 
never yield the lowest cost to the destination. This property is 
the key factor that allows us to reduce the complexity of the 
proposed algorithms from exponential to polynomial time. For 
n neighbors, we do not have to test every one of the 2™ — 1 
possible forwarding sets. Instead, we only need to check at 
most n forwarding sets. 

Lemma 5: For a given transmission rate r G R, assume 
that (f>i — {1,2, ...,fc} with costs 5\ < 62 < ■■• < 5 k . 
If D\ is the cost from node i using transmission rate r via 
forwarding set {1, 2, . . . , j}, for 1 < j < k, then we always 
have D}>Df>...> D\ = <^ r) . 

Lemma [5] explains another important property necessary for 
the proposed routing algorithms to converge. Assuming that 
the best forwarding set faP for transmission rate r G R is 
0^ = {1, 2, . . . , k} with costs 5i < 5 2 < ■ ■ ■ < 5 k , the cost 
Di monotonically decreases as we use each of the forwarding 
sets {l},{l,2},{l,2,3},...,{l,2,...,fc}. 

We now present the proof of optimality of our algorithms. 

Theorem 1: Optimality of the SMAF algorithm. 

Let G = (V, E) be a weighted directed graph and let d be 
the destination. After running the Shortest Multirate Anypath 
First algorithm on G, we have Di — Si for all nodes i G V. 



Proof: This proof is similar to the proof of Dijkstra's 
algorithm [19|. We show that for each node s G V, we have 
D s = 5 S at the time s is added to S. 

For the purpose of contradiction, let s be the first node added 
to S for which D s ^ S s . We must have s ^ d because d is 
the first node added to S and Dd — 5d = at that time. Just 
before adding s to S, we also have that S is not empty, since 
s ^ d and S must contain at least d. We assume that there must 
be a multirate anypath from s to d, otherwise D s = 5 S = 00, 
which contradicts our initial assumption that D s ^ 5 S . If there 
is at least one multirate anypath, there is a shortest multirate 
anypath a from s to d. Let us consider a cut (V — S, S) 
of a, such that we have s G V — S and d G S, as shown in 
Fig. [7] Let the set J be composed of nodes in V — S that have 
an outgoing link to a node in S. Likewise, let the set K be 
composed of nodes in S that have an incoming link from a 
node in V — S. 




Figure 7. The shortest multirate anypath a from s to d. Set S must be 
nonempty before node s is inserted into it, since it must contain at least d. 
We consider a cut (V — S, S) of a, such that we have s £ V — S and d € S. 
Nodes s and d are distinct but we may have no hyperlinks between s and J, 
such that J = {s}, and also between K and d, such that K = {d}. 

Without loss of generality, assume that node i e J has the 
lowest cost to d among all nodes in V — S. That is, Si < Sj 
for all j G V — S. We claim that every edge leaving node i 
must necessarily cross the cut (V — S, S). Thus, for every 
edge leaving node i, we must have j G S. To prove this 
claim, let us assume that node i has an edge to another 
node j G V — S. By Lemma |2] we know that in this case we 
must have Si > 5j . However, since we assumed that node i has 
the lowest cost in V — S, then Si < Sj and such an edge could 
only exist if Si — Sj . By Lemma [3] we know that if Si = Sj 
then the link is redundant, and we can safely remove 

it from the multirate anypath without changing its cost. As a 
result, for every edge we must have j G S. Fig. |7]shows 
this situation where node i only has links to nodes in S. 

Additionally, we claim that the nodes in S were settled in 
ascending order of cost. That is, if Sj < 5 k then node j was 
settled before node k. Since node i has the lowest cost to d 
among all nodes in V — S, settling s before i implies that s is 
settled "out of order." For the purpose of contradiction, let s 
be the first node settled out of order. 

We now claim that Di — Si at the time s is inserted into S. 
To prove this claim, notice that K C S. Since s is the first 
node for which D s ^ 5 S when it is added to S, then we 
must have Dk = 5k, for every k G K. Let fa C K be the 
forwarding set used in the shortest multirate anypath from i 
to d using the optimal transmission rate p G R. By Lemma |4] 
fa is composed of the neighbors of i with the lowest cost to d. 
Assume that fa = {1,2, ... ,j} with 5% < 5% < . . . < Sj. 
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Since s is the first out-of-order node, we know that the nodes 
in S were settled in order. Therefore, node 1 was settled before 
node 2, which was settled before node 3, and so on. At the 
time node 1 is settled, the forwarding set F^ is initialized to 
= {1}. When node 2 is settled, there is no need to check 
the forwarding set {2}. By Lemma [4] this forwarding set is 
never optimal so we just check the set {1,2}. By Lemma [5] 
using {1, 2} always provides a lower cost than using just {1}. 
The forwarding set is then updated to F,^ = {1,2}. The 
same procedure is repeated for each settled node, until we 



set. As a result, we must have = S\' ' for every rate 

r € R at the end of the (t + l)-th iteration. Therefore, after 
selecting the best rate we have -Dj = 5$. ■ 

V. Experimental Results 

We evaluated the proposed multirate algorithm using an 
18-node 802.11b indoor testbed. Each node is a Stargate 
microserver ll20l equipped with an Intel 400-MHz Xscale 
PXA255 processor, 64 MB of SDRAM, 32 MB of Flash, 
and an SMC EliteConnect SMC2532W-B PCMCIA 802.11b 
wireless network card using the Prism2 chipset. This card has 
a maximum transmission power of 200 mW. The nodes of 
the testbed are distributed over the ceiling of the Center for 
Embedded Networked Sensing (CENS) at UCLA. The nodes 
are located in an approximate 2x9 grid and roughly five to ten 
meters apart from each other. Fig. [8] depicts the location of 
the nodes in the testbed. Each node is equipped with a 3-dB 
omni-directional rubber duck antenna for the wireless com- 
munication. In order to emulate a wireless mesh network with 
multiple hops, we use a 30-dB SA3-XX attenuator between 
the wireless interface and its antenna. The attenuator weakens 
the signal during both the transmission and the reception of a 
frame, emulating a large distance between nodes. For 1 1 Mbps, 
we have paths of up to 8 hops between each pair of nodes, 
with 3.1 hops on average. For 1 Mbps, we have a longer 
transmission range, which reduces the maximum path length 
to 3 hops, with an average of 1.5 hops between each pair of 
nodes. 



4>i = {1, 2, . . . ,j}. At this time, we also 

= = 5,, 



finally have F^ 

have D± = Si, which triggers the update D, 
Fi = -F 1 / = <pi, and Tj = p. Once D t is equal to the lowest 
cost Si, it does not change anymore and we have Di — Si at 
the time s is inserted into S. 

We can now prove the theorem with two contradictions. 
Since node i occurs after node s in the shortest multirate any- 
path to d, by Lemma [2] we have Si < S s . In addition, we must 
also have S s < D s because D s is never smaller than S s . Since 
both i and s are in V — S and node s was chosen as the one 
with the minimum cost from Q, then we must have D s < Di 
and Si < S s < D s < Di. From our previous claim, we know 
that Di = Si and therefore Di — Si < S s < D s < Di, from 
which we have Di — Si = S s = D s . As a result, s is not 
settled out of order since i has the lowest cost in V — S and 
S s = Si . From this we conclude that the nodes in S are settled 
in ascending order of cost. Additionally, we also have D s = S s 
at the time s is added to S, which contradicts our initial choice 
of s. We conclude therefore that for each node s £ V we have 
D s = S s at the time s is added to S. ■ 

Theorem 2: Optimality of the MABF algorithm. 

Let G = (V, E) be a weighted directed graph and let d be 
the destination. After running the Multirate Anypath Bellman- 
Ford algorithm on G, we have Di — Si for every node i G V. 

Proof: We prove this theorem by induction on t, the 
iteration number. Let hi be the number of hops of the longest 
path from i to d. We show that, after the t-th iteration, we have 
Di = Si for every node with hi < t. Intuitively, the algorithm 
works from the destination backwards to the source in an 
expanding-ring fashion, settling at each iteration the nodes one 
hop further away from the destination. Since we can not have 
paths with more than \V \ — 1 links, we are guaranteed to have 
Di = Si for every node i 6 V after \V\ — 1 iterations. The 
induction proof now follows. 

Basis. For t = 0, the only node with hi < is the destina- 
tion d itself. We have from the initialization that Dd = Sd = 0. 

Inductive step. Assuming that after the t-th iteration we 
have Di = Si for every node with hi < t, we want to 
show that after the (t + l)-th iteration we have Di = Si for 
every node with hi < t + 1. At the (t + lVth iteration, a 
node i with hi = t + 1 calculates its cost D^' after checking 
the forwarding sets {1}, {1, 2}, . . . , {1, 2, . . . , n} in this order, 
with Si < S2 < ■ ■ ■ < S„ being the costs of the neighbors. 
Since hi = t + 1, every neighbor j in the optimal forwarding 
set must necessarily have hj < t, and we know from the 
induction hypothesis that Dj = Sj. From Lemmas |4] and [5] this 
strategy is guaranteed to converge to the optimal forwarding 




Figure 8. The location of nodes in the testbed, in an approximate 2x9 grid. 

We use the testbed to measure the delivery ratio of each 
link at different transmission rates. For that purpose, each 
node broadcasts one thousand 1500-byte packets and later on 
we collect the number of received packets at neighbor nodes. 
We repeat this process for 1, 2, 5.5, and 11 Mbps to have 
a link estimate for each transmission rate. We use the Click 
toolkit ETI and a modified version of the MORE software 
package [6| for the data collection. Our implementation is 
capable of sending and receiving raw 802.11 frames by using 
the wireless network interface in monitor mode. We modified 
the HostAP Prism driver ll22~l for Linux in order to allow 
not only 802.11 frame overhearing but also frame injection 
while in monitor mode. In addition, we extended the HostAP 
driver to enable it to control the transmission rate of each 
802.11 frame sent. The Click toolkit tags each frame with a 
selected transmission rate and this information is then passed 
along to the driver. For each frame, our modification reads the 
information tagged by Click and notifies the wireless interface 
firmware about the specified transmission rate. 
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Fig. [9] shows the distribution of the delivery ratio of each 
link in the testbed at different 802.11b transmission rates. 
Every node pair contributes with two links in the graph, one 
for each direction. Links of each rate are placed in order 
from largest to smallest (i.e., in rank order). The points of 
each curve are sorted separately, and therefore the delivery 
ratios of a given x-value are not necessarily from the same 
link. In wireless mesh networks, higher transmission rates 
usually have shorter transmission ranges and therefore a lower 
network connectivity. We can see this behavior in Fig. [9] 
As the transmission rate increases, we can see that we have 
fewer links available and therefore less path diversity between 
nodes. For instance, as shown by the dashed horizontal line, 
the number of links with a delivery ratio higher than 50% is 
151 at 1 Mbps, 109 at 2 Mbps, 95 at 5.5 Mbps, and only 
47 at 11 Mbps. With fewer paths available at higher rates, 
we have an interesting tradeoff for multirate anypath routing. 
With a lower transmission rate, we have more path diversity 
and a shorter number of hops to traverse, but also a lower 
throughput. On the other hand, a higher rate results in a higher 
throughput, but also in less path diversity and a larger number 
of hops. Our algorithm explores this tradeoff and selects the 
optimal transmission rate and forwarding set for every node. 



other studies 03], (23 j. We use this observation to derive our 
next results. 
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Figure 9. The delivery ratio of the testbed links for each transmission rate. 
The data points for each curve are placed in order from largest to smallest 
(i.e., in rank order). As the rate increases, fewer links are available and thus 
path diversity decreases. 

Fig. [10] shows the results of an experiment we conducted 
to test the independence of receivers. In our experiment, a 
node individually broadcasts 500,000 data frames at 1 1 Mbps 
to four neighbors and each frame has 1500 bytes. The x-axis 
represents the 16 possible set of receivers for the frame (i.e., 
set corresponds to the frame being lost by all neighbors and 
set 15 corresponds to every neighbor correctly receiving the 
frame). The y-axis represents the fraction of packets received 
by each set. The "observed" histogram is directly derived from 
the data. The "independent" histogram is derived by assuming 
that the loss probability at each receiver is independent of each 
other, so it is calculated simply by multiplying the respective 
probabilities of each individual receiver. We can see that both 
functions are pretty close, indicating that the delivery ratios of 
each receiver are loosely correlated in light load regimes. This 
experiment was repeated for other nodes in the testbed and a 
similar behavior was observed, which is also consistent with 
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Figure 10. (a) Distribution of frame receptions at four neighbors. For four 
neighbors, we have 2 4 = 16 subsets and each one represents a different set 
of neighbors who correctly received the frame. Packet reception at different 
neighbors is independent for light load regimes. 



The shortest multirate anypath always has an equal or 
lower cost than the shortest single-rate anypath. Otherwise, we 
would have a contradiction since we can find another multirate 
anypath (i.e., the single-rate anypath) with a lower cost to the 
destination. It is important, however, to quantify how much 
better multirate anypath routing is over single-rate anypath. 
For this purpose, we calculate the gain of multirate over single- 
rate anypath. We define the gain of a given source-destination 
pair as the ratio between the single-rate anypath cost and the 
multirate anypath cost between these two nodes. This metric is 
then a multiplicative factor representing how much longer the 
end-to-end transmission time is at single-rate anypath routing 
when compared to multirate anypath routing. 

Fig. |1 l(a)| shows the distribution of this gain for every pair 
of nodes in the network. Each curve represents the gain over 
single-rate anypath routing at a fixed rate. We see that the 
end-to-end transmission time with multirate anypath routing 
is at least 50% and up to 11.3 times shorter than with single- 
rate anypath routing at 1 Mbps, with an average gain of 5.4. 
For higher rates, we also see an interesting behavior depicted 
by the vertical lines. These lines indicate that several node 
pairs have an infinite gain. The infinite gain occurs because 
these nodes can not talk to each other at that particular rate 
due to the poor link quality; the network therefore becomes 
disconnected. We have 17 (5.6%) node pairs that can not reach 
each other at both 2 and 5.5 Mbps, and 33 (10.8%) node pairs 
out of reach at 1 1 Mbps. For the network to be connected, we 
must then either use a lower rate (i.e., 1 Mbps) for the whole 
network at the cost of a lower throughput or use multirate 
anypath routing. For 2 Mbps, if we remove the node pairs 
with infinite gains, we have a gain of at least 91% and up 
to 5.6, with an average of 3.2. For 5.5 Mbps, we have a gain 
up to 2.0, with an average of 22%. Finally, for 1 1 Mbps, we 
have a gain up to 6.4, with an average of 80%. 

Fig. |1 l(b)| shows the reason why multirate always performs 
better than single-rate anypath routing. In this graph we show 
the distribution of the optimal transmission rates selected by 
each node to reach every other node. We can see that the 
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Figure 1 1 . Results of the SMAF algorithm for the wireless testbed. (a) Gain of multirate over single-rate anypath routing. For each node pair, we indicate in 
the y-axis how many times multirate anypath routing is better than single-rate anypath. (b) Histogram of the transmission rate chosen by each node. Optimal 
transmission rates are not concentrated at any particular rate, indicating that a single-rate algorithm can not perform as well as a multirate algorithm. 



optimal transmission rates are not concentrated at a single 
rate, but rather distributed over several possibilities. We have 
10.8% of node pairs using 1 Mbps, 41% using 5.5 Mbps, and 
47% using 1 1 Mbps as the optimal rate. Interestingly enough, 
no node pair selected 2 Mbps as the optimal rate since it 
was more beneficial to use another rate instead. If these rates 
were 100% concentrated at a particular rate, then multirate and 
single-rate anypath routing would have the same cost. This 
assumption, however, does not hold in practice, and therefore 
multirate anypath routing always has a higher performance, 
sometimes manyfold higher as shown in Fig. |1 l(a)| than 
single-rate anypath routing. 

VI. Related Work 

Most of the work in anypath routing focuses on using a 
single transmission rate. The following works are all single- 
rate anypath routing schemes. 

Zorzi and Rao [18] use a combination of opportunistic and 
geographic routing in a wireless sensor network. The authors 
assume that sensor nodes are aware of their locations and this 
information is used for routing. The forwarding set of a given 
node is composed of the neighbors which are physically closer 
to the destination. Packets are broadcast and neighbors in the 
set forward the packet respecting the relay priority explained 
in Section HU As an advantage, this routing procedure does not 
need any sort of route dissemination over the network. Using 
just the physical distance as the routing metric, however, may 
not be the best approach since it does not take link quality into 
account. We introduce the EATT routing metric that takes not 
only the link quality but also the multiple transmission rates 
into account during route calculation. 

Ye et al. [24] present another single-rate opportunistic 
routing protocol for sensor networks. The key idea is that each 
packet carries a credit which is initially set by the source and 
is reduced as the packet traverses the network. Each node also 
maintains a cost for forwarding a packet from itself to the 
destination, and nodes closer to the destination have smaller 
costs. Packets are sent in broadcast and a neighbor node 
forwards a received packet only if the credit in the packet 
is high enough. Just before forwarding the packet, its credit is 



reduced according to the node cost; therefore, more credits are 
consumed as the packet moves away from the shortest path. 
A mesh around the shortest path is then created on the fly for 
each packet. Yuan et al. |25| use a similar idea for wireless 
mesh networks. Although packet delivery is improved, this 
routing scheme increases overhead since it is based on a 
controlled flooding mechanism. Therefore, robustness comes 
at the cost of duplicate packets. In our proposal, a packet 
is forwarded by a single neighbor in the forwarding set and 
a MAC mechanism, such as the one proposed by Jain and 
Das [13 1, is in place to guarantee that no duplicate packets 
occur in the network. 

Biswas and Morris [7] designed and implemented ExOR, 
an opportunistic routing protocol for wireless mesh networks. 
ExOR follows the same guidelines of single-rate anypath rout- 
ing explained in Section HI] Basically, a node forwards a batch 
of packets, and each neighbor in the forwarding set waits its 
turn to transmit the received packets. The authors implement 
a MAC scheduling scheme to enforce the relay priority in the 
forwarding set. As a result, a node only forwards a packet if 
all higher priority nodes failed to do so. The authors show 
that opportunistic routing increases throughput by a factor of 
two to four compared to single-path routing. Our results go 
beyond that and show that an even better performance can be 
achieved with multirate anypath routing. Additionally, in our 
design, each packet is routed independently without storing 
any per-batch state at intermediate routers. 

Chachulski et al. |6| introduce MORE, a routing protocol 
which uses both opportunistic routing and network coding to 
increase the network end-to-end throughput. Upon the receipt 
of a new packet, a node encodes it with previously received 
packets and then broadcasts the coded packet. Results show 
that MORE allows a higher throughput than ExOR and single- 
path routing. Network coding, however, requires routers to 
store previous packets in order to code them with future 
packets, adding significant storage and processing overhead to 
the forwarding process. Furthermore, the authors only focus 
on opportunistic routing with a single transmission rate. Our 
results indicate that performance could be further improved 
with multirate anypath routing. An analysis of multirate any- 
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path routing and network coding is also an open problem and 
an interesting topic for future work. 

Besides using a single bit rate, the above-mentioned systems 
also do not have a systematic approach for selecting the for- 
warding set for a given destination. The selection is commonly 
based on the heuristic that if a neighbor has a smaller ETX 
cost to the destination, then it should be in the forwarding 
set. However, the ETX is a single-path metric and does not 
correctly represent the true cost when using anypath routing. 
To our knowledge, Zhong et al. [8j was the first to propose 
the expected anypath number of transmissions (EATX) metric 
described in Section [II] which was also used in J6], (9). 
The authors propose an algorithm for forwarding set selection 
in J26'|, but this algorithm is not proven optimal. 

Dubois-Ferriere et al. introduced a shortest anypath 
algorithm capable of finding optimal forwarding sets. The 
authors generalize the well-known Bellman-Ford algorithm for 
anypath routing and prove its optimality. Performance tests in 
a wireless sensor network show that anypath routing signif- 
icantly reduces the required number of transmissions from a 
node to the sink. The running time of this algorithm, however, 
is exponential. Chachulski |6| presents a generalization of 
Dijkstra's algorithm for anypath routing that is similar to 
the one we independently derived in Section IIV-AI but the 
author does not provide any proof of optimality. Both of these 
algorithms, however, are designed for networks using a single 
transmission rate. Instead, our algorithms in Section IIV-BI 
generalize anypath routing for multiple rates, giving nodes the 
ability to choose both the best rate and the best forwarding 
set to a particular destination. We also provide the proof of 
optimality for our algorithms. As a result, the optimality of 
the single-rate Dijkstra's algorithm in [6| is also proved since 
this is a special case of our algorithm. In a concurrent work, 
Lu and Wu ll27l propose a routing algebra for opportunistic 
routing and also introduce similar algorithms for single-rate 
anypath routing. 

More recently, multiple transmission rates have been ad- 
dressed in opportunistic routing. Radunovic et al. |28| presents 
an optimization framework to derive routing, scheduling, 
and rate adaptation schemes. Zeng et al. ifTTI presents a 
linear-programming formulation to optimize the end-to-end 
throughput of opportunistic routing, considering multiple rates 
and transmission conflict graphs. However, in both cases the 
authors try to optimize several components simultaneously, 
and therefore the posed problem becomes NP-hard. Heuristics 
are then applied to find a solution, which is not necessarily 
optimal and may not be easily implemented. Instead, we focus 
on the shortest multirate anypath problem and provide an 
optimal solution for it in polynomial time. 

VII. Conclusions 

In this paper we introduced multirate anypath routing, a 
new routing paradigm for wireless multihop networks. We 
provided a solution to integrate opportunistic routing and mul- 
tiple transmission rates. The available rate diversity imposes 
several new challenges to routing, since transmission range 
and delivery ratios change with the transmission rate. Given 



a network topology and a destination, we set out to find both 
a forwarding set and a transmission rate for every node, such 
that their cost to the destination is minimized. We pose this as 
the shortest multirate anypath problem. Finding the rate and 
forwarding set that jointly optimize the cost from a node to a 
given destination was previously considered an open problem. 
To solve it, we introduced the EATT routing metric as well as 
the Shortest Multirate Anypath First (SMAF) and the Multirate 
Anypath Bellman-Ford (MABF) algorithms and presented a 
proof of their optimality. Our algorithms have roughly the 
same complexity as regular shortest-path algorithms, being 
easy to implement in current routing protocols. 

We conducted experiments in a 18-node 802.11b testbed to 
evaluate the performance of multirate over single-rate anypath 
routing. Our main findings are: (1) when the network uses a 
single bit rate, it may become disconnected since some links 
may not work at the selected rate; (2) multirate outperforms 
single-rate 11-Mbps anypath routing by 80% on average and 
up to a factor of 6.4 while still maintaining full connectivity; 
(3) multirate also outperforms single-rate 1-Mbps anypath 
routing by a factor of 5.4 on average and up to a factor 
of 11.3; (4) the distribution of the optimal transmission rates 
is not concentrated at any particular rate, corroborating the 
assumption that nodes in single-rate anypath routing usually 
do not transmit at their optimal rates. 
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Appendix 

Lemma [7} For a fixed transmission rate, let Di be the cost 
of a node i via forwarding set J and let D[ be the cost via 
forwarding set J' — J U {k}, where D k > Dj for every node 
j G J. We have D[ < Di if and only if Di > D k . 

Proof: Assume that D\ < D 2 < ■ ■ ■ < D k -i < D k and 
J = {1, 2, . . . , k — 1}. Let Di = dij + Dj be the cost from 
node i using the forwarding set J. From (0, the remaining 
anypath cost is generally defined as D j = Y^jeJ w ijDj, w i tn 
Yljej w ij ~ 1' wnere the weight tuy is the probability of 
using node j as the relay, given that at least one node in J 
received the packet. Let D[ = dw + Dj, be this cost via 



J' = J U {k}. First, we write Dji in terms of Dj as 

Djl = EiL Dj+ f 1 _PiL\ Dk) (ii) 

pw V PW J 

where pu/pw scales the weights in Dj to account for the 
new forwarding set J' by changing the probability of the 
condition in the denominator of w^. The probability in the 
numerator of does not change. The (1 — Pu/pw) factor 
is the conditional probability that node k is the relay, given 
that at least one node in J' received the packet. An interesting 
result from ( fTTT ) is that we can see the forwarding set J as an 
"aggregated node" with delivery ratio p t j and cost Dj. 
We now show that if Di > D k , then D[ < Di as follows 

Di > D k 

{du + Dj) D k 

du + Dj> ^-du + ^-Dj D k 
Pj> Pj> \ pj' J 

Di > d tJ , + Dj, 

Di > D\. (12) 

To show that if D[ < D t then D t > D k , we just take (fT2l 
in the reverse order. Consequently, if Di > D k , it is better to 
use the forwarding set J' = J U {k} instead of J, since the 
cost D[ via J' is always lower than Di via J. ■ 

Lemma [2} The lowest cost Si of a node i is always larger 
than or equal to the lowest cost 5j of any node j in the optimal 
forwarding set (pi. That is, we have Si > Sj for all j G (pi. 

Proof: Let <pi — {1,2, ... ,k} be the optimal forwarding 
set with Si < S 2 < ■ ■ ■ < S k and let D t > Si be the cost 
via the suboptimal forwarding set J = {1, 2, . . . , fc — 1} with 
the same transmission rate. From Lemma Q] we know that if 
Si < Di, then Di > S k . From this, we show that Si > S k as 
follows (assume J' is the optimal forwarding set (pi) 

Di > 5 k 
(g-) (di J+Dj )>^S k 

EL diJ + 2L Dj > Sk - U-2L) Sk 
pj' p.j' V pj' ) 

d U ' + —Dj +(i-*£-)5 k > S k 

pj' V pj' J 

diJ> + Dj, > S k 

Si > S k . (13) 

Since 5 k is the highest cost in the optimal forwarding set (pi, 
then we know that if Si > S k , then Si > Sj for all j G (pi. ■ 

Lemma \3} For any transmission rate, if a node i uses a 
node k in its optimal forwarding set (pi and Si — S k , we can 
safely remove k from (pi without changing St. The link (i,k) 
is said to be "redundant." 

Proof: By Lemma [2] we have Si > Sj , for all j G (pi . 
Since Si = S k , we also know that S k is the highest cost in the 
forwarding set. Let J' — (pi — {1,2, ... ,k} be the optimal 
forwarding set with S\ < S% < . . . < S k and let Di = dij+Dj 
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be the cost from node i via J = {1,2, ... ,k 
show that if Si = 4, then Di — Si as follows 



1}. We now 



HJ' 



PiJ 
PiJ' 



8- 


= 4 
u k 


du> + Dj> 


= s k 


fl PiJ \ X 
1 4 


= o k 


V Pij> ) 




dij> + Dj 


= 4-1 


Pw 




a , PiJ n 
(Zjj' H -Dj 


- —8 


Pw 


Pw 




= 8 k 


P»j 




du + Dj 


= 5 k 
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= 4- 



PlJ 
PiJ' 



4 



(14) 

Since Di = Sk, the forwarding set J is also optimal and yields 
the same cost as </>,;. We say the link (i, k) is "redundant" since 
it does not help to reduce the cost any further. ■ 

Lemma ^ If the lowest costs from the neighbors of a 
node i to a given destination are Si < 8% < . . . < 8 n , 
then the optimal forwarding set qy, is always of the form 
0,[ r) = {1,2,..., k}, for some k G {1, 2, . . . , n}. 

Proof: Define a sequential forwarding set as a set in which 
neighbors are grouped without any gaps in the cost sequence 
(i.e., a set of the form {1, 2, . . . , I — 1, 1}). Now assume that 

(r) 

the optimal forwarding set J = <fy, ' is not sequential. Let 8% 
be the cost of node i via J, and let / be the neighbor with 
the highest cost in J. Since J is not sequential, there must be 
at least one node k £ J such that 8k < 8i. Without loss of 
generality, let k < I be the lowest cost neighbor that is not 
in J, and let D\ be the cost of i via J' = J U {k}. If J is the 
optimal forwarding set, then Si < D\ and 
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PiJ' 



5,. < D' 



PiJ 
Pw 



D, 



Pu Dj 
Pw 



(15) 



where the last equality holds because dw = dijpij/pij>. By 
Lemma |2] we know that Si > 8i and from ( TT3T > we have 
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(16) 

where we replace each 8j with Sk since w^Pu I Pw ~w'^ = 
for <5j < Sk and non-negative for <5j > Sk- As a result, Sk > 
However, since by definition Sk < 8k+i < ■ ■ ■ < <5/_i < 
then we must have ^ = Jfe+i = . . . = = 5;, which 
contradicts our initial assumption that the optimal forwarding 
set is not sequential. ■ 



Lemma [5} For a given transmission rate r G R, assume 
that 4>"p — {1,2, ... ,k} with costs 8% < 82 < ••• < Sk. 
If Dj is the cost from node i using transmission rate r via 
forwarding set {1, 2, . . . ,j}, for 1 < j < k, then we always 
have D\>Df>...> D\ = 8 { f' '. 

Proof: We want to prove that the set J = {1} yields 
a higher cost than J' = {1,2}, which yields a higher cost 
than J" = {1,2,3} and so on until we get to the optimal 
forwarding set <fi^ — {1,2,..., fc}. Thus far, we have 



(a) (6) 

4-i < Sk < Si 



(d) 

Df < D 



fc-i 



(17) 



where (a) and (c) hold by definition, (b) holds by Lemma [2] 
and (rf) holds because (f>^ = {1, 2, . . . , k} yields the lowest 
cost to the destination at rate r. 

We now extend this result further for other forwarding sets. 
We first claim that 



(a) 

4-2 < 4- 



< 4 < Si = IK < I) 1 : 1 < ir 



(&) 



ik-2 



(18) 



where (a) holds by definition and (b) holds because of the 
following argument. By definition, we have Si = D\ < D^ 2 , 
since D\ is the lowest cost to the destination. From ( TTTb . we 



then have that 8, 



k-l 



< D 



fc-2 



Finally, if 4 



1 < D k ~ 2 , then 



D h i~ x < D\~ 2 by Lemma Q] 

The same argument can be made recursively until we get 

Si < . .. < 4-i < 4 < Si = D k ; < D*- 1 <...< D|(19) 

from which we know D) > Dj > . . . > Df must be true. ■ 



